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5 METHOD AND SYSTEM FOR HIGH BANDWIDTH-EFFICIENCY 

COMMUNICATIONS USING SIGNALS HAVING POSITIVE ENTROPY 

Field of the Invention 

The present invention relates generally to a method and/or system for high 
10 bandwidth-efficiency communications using a broadband signal, and more particularly to 
a method and/or system for high bandwidth-efficiency communications using a signal 
having a positive entropy. 



15 



Background of the Invention 



Conventionally, in communications, a baseband signal is modulated onto a 
periodic carrier signal. The baseband signal is a signal with a frequency spectrum from 
zero to a band-limited value. Typically, the range of frequencies in the frequency 
spectrum is dependent on the information to be transmitted. Because the carrier signal is 

20 periodic, it has zero entropy and contains no information. One may find the information 
capacity of the signal by considering only the baseband signal. Information capacity is 
understood as described below. 

Most research in the field of nonlinear dynamics on methods of improving 
communication is directed to improving the power efficiency of signals, where power 

25 efficiency is defined as the energy to send one bit of information normalized by the noise 
, power per unit of frequency (i.e., noise power spectral density). In a few cases, power 
efficiencies of communications methods developed using ideas from nonlinear dynamics 
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5 approach the power efficiency of existing communications methods, but most new 

methods based on nonlinear dynamics are not very power efficient. See, e.g., A. Abel, 

W. Schwartz, and M. Goetz, "Noise Performance of Chaotic Communication Systems," 

IEEE Transactions on Circuits and Systems Part I, vol. 47, December pp. 1726-1732, 

2000, C. Williams, "Chaotic Communications over Radio Channels," IEEE Transactions 

10 on Circuits and Systems Part I: Fundamental Theory and Applications, vol. 48, 
December pp. 1394-1404, 2001, and M. P. Kennedy, G. Kolumban, and G. Kis, 
"Chaotic Modulation for Robust Digital Communications over Multipath Channels," 
International Journal of Bifurcations and Chaos in Applied Science and Engineering, 
vol. 10,2000 pp. 695-7 #18, 2000, each incorporated herein by reference. 

15 Binary phase shift keying ("BPSK") has the highest power efficiency theoretically 

possible for antipodal signals, such as sines and cosines. See, e.g., B. Sklar, Digital 
Communications, Fundamentals and Applications. Englewood Cliffs, NJ: Prentice Hall, 
1988, incorporated herein by reference. In BPSK, the phase of a periodic carrier signal is 
switched to +180 or -180 degrees to represent binary 1 or 0. While BPSK is very power 

20 efficient, it requires a lot of bandwidth to transmit each bit of information, so it is not 

very bandwidth-efficient. Williams discloses that because chaotic signals have structures 
that are preserved by all but the most extreme filtering, chaotic signals may be useful for 
communicating with high bandwidth efficiency. 

T. M. Cover et al., Elements of Information Theory. New York: Wiley, 1991 

25 ("Cover et al."), S. Hayes et al., "Experimental Control of Chaos for Communication," 
Physical Review Letters, vol. 73, September pp. 1781-1784, 1994 ("Hayes et al."), M. 
S. Baptista et al., "Controlling transient dynamics to communicate with homoclinic 
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5 chaos," Chaos, vol 13, September pp. 921-925, 2003, M. S. Baptista et al., "Conditions 

for efficient chaos-based communication," Chaos, vol 13, March pp. 145-150, 2003, E. 

M. Bollt, "Review of chaos communication by feedback control of symbolic dynamics," 

International Journal of Bifurcations and Chaos, vol. 13, February pp. 269-285, 2003, 

S. D. Pethel et al., "Information flow in chaos synchronization: Fundamental tradeoffs in 

10 precision, delay, and anticipation," Physical Review Letters, vol. 90, June pp. 254101, 
2003, each incorporated herein by reference, generally discuss the application of signals 
such as chaos to communications. Hayes et al. discloses that chaotic carriers may be 
utilized as information carriers because of their positive entropy, and several groups have 
attempted to apply some of Hayes et al.' ideas. Entropy as it relates to signals is 

1 5 understood as follows. If the probability of a signal having a certain value x is p(x), then 
the entropy of the signal is -E [ p(x) * log(p(x))]. See, e.g., Cover et al. The entropy is 
related to the amount of information created in a signal. For instance, the entropy of a 
sine wave is zero because the signal is the same for every cycle. 

U.S. Patent No. 3,925,730 to de Rosa, incorporated herein by reference, discloses 

20 a prior art secure communications system that antedates Hayes et al. de Rosa discloses a 
plurality of noise signals each having a predetermined time delay with respect to each 
other that are produced from atmospheric noise or man-made noise. Each of the noise 
signals is coupled to different time coincident devices. The intelligence signal is 
quantized and the output levels therefrom are coupled to different ones of the coincident 

25 devices to select a noise signal to represent the quantized level. The selected noise 

signals are transmitted to a receiver in which replicas of the noise signals are generated. 
A plurality of correlation detectors each responsive to a given noise signal and its replica 
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5 are provided in the receiver to recover the intelligence signal However, de Rosa's 

system lacks practical scalability of its symbol set size. More specifically, de Rosa's 

system includes one AND gate for a given input data symbol. There is a practical limit to 

the number of delays that can be added pursuant to de Rosa's disclosure because after a 

point, the chaotic carrier signal repeats or substantially conforms to an earlier pattern. 

10 After that point, no additional, distinguishable symbols can be added to de Rosa's symbol 

set. 

U.S. Patent No. 4,285,048 to Casasent et al, incorporated herein by reference, 
discloses a correlation method and apparatus for electrical signal transmission and 
reception of coded waveforms are disclosed which makes use of a coordinate 

15 transformation of the original waveform prior to transmission, effecting an inverse 
coordinate transformation upon reception and then correlating the resultant waveform 
with the original waveform. More particularly, the coordinate transformation and its 
inverse comprises a non-linear transformation preferably of the logarithmic type which 
when utilized in an electro-optical signal processor of a radar system, for example, 

20 provides Doppler invariant output data, as well as additional noise immunity. Casasent et 
al. fails to teach or suggest any application of the disclosure to anything other than 
traditional signals having zero entropy. 

Brief Summary of the Invention 

25 

An embodiment of the present invention is directed to a communications device 
that includes a symbol encoder for receiving data comprising a symbol and for receiving 
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5 a first signal having a positive entropy. The symbol encoder adds to the first signal a 

plurality of delayed versions of the first signal. Each delayed version of the plurality of 

delayed versions has a plurality of available values. The symbol is represented by a set 

of delay values, a delay value of the set of delay values including an available value of 

the plurality of available values for the each delayed version of the plurality of delayed 

10 versions. The communications device also includes a transmitter for receiving the 
encoded data from the symbol encoder and for transmitting the encoded data. For 
example, the first signal having positive entropy includes a chaotic signal, noise signal, or 
a positive entropy, baseband signal modulated onto a positive entropy signal having a 
higher frequency than the baseband signal. For example, the chaotic signal includes a 

15 Lorenz system-generated chaotic signal or a Rossler system-generated chaotic signal. 

An embodiment of the present invention is directed to a communications device 
for receiving encoded data. The communications device includes a receiver for receiving 
a first signal having positive entropy added to a plurality of delayed versions of the first 
signal. Each delayed version of the plurality of delayed versions includes a plurality of 

20 available values. Encoded data includes a symbol, the symbol being represented by a 
plurality of delay values. A delay value of the plurality of delay values includes an 
available value of the plurality of available values for the each delayed version of the 
plurality of delayed versions. The communications device includes a symbol decoder for 
receiving the encoded data from said receiver. The symbol decoder sums a second 

25 signal, substantially similar to the first signal, and a plurality of reference delays. The 
symbol decoder maximizes a cross-correlation between the encoded data and the sum of 
the second signal and the plurality of reference delays. For example, the first signal 
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5 having positive entropy includes a chaotic signal, noise signal, or a positive entropy, 

baseband signal modulated onto a positive entropy signal having a higher frequency than 

the baseband signal. For example, the chaotic signal includes a Lorenz system-generated 

chaotic signal or a Rossler system-generated chaotic signal. In an alternate embodiment 

of the invention, the communications device further includes an equalizer communicating 

10 with the receiver and with the symbol decoder. 

In an additional embodiment of the instant invention, a communications device 
for receiving encoded data includes a receiver for receiving a first signal having positive 
entropy added to a plurality of delayed versions of the first signal. Each delayed version 
of the plurality of delayed versions includes a plurality of available values. Encoded data 

15 includes a symbol. The symbol is represented by a plurality of delay values. A delay 
value of the plurality of delay values includes an available value of the plurality of 
available values for the each delayed version of the plurality of delayed versions. The 
communications device includes a symbol decoder for receiving the encoded data from 
the receiver. The symbol decoder sums a third signal, being a weighted version of the 

20 first signal, and a plurality of weighted reference delays. The symbol decoder performs a 
least squares fit between the encoded data and the sum of the third signal and the plurality 
of weighted reference delays. For example, the first signal having positive entropy 
includes a chaotic signal, noise signal, or a positive entropy, baseband signal modulated 
onto a positive entropy signal having a higher frequency than the baseband signal. For 

25 example, the chaotic signal includes a Lorenz system-generated chaotic signal or a 
Rossler system-generated chaotic signal. In an alternate embodiment of the present 
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5 invention, the communications device further includes an equalizer communicating with 

the receiver and with the symbol decoder. 

An embodiment of the present invention is directed to a communications method 

that includes the following steps. A first signal having a positive entropy is provided, and 

a plurality of delayed versions of the first signal is provided. Each delayed version of the 

10 plurality of delayed versions includes a plurality of available values. Data including a 
symbol is encoded by representing the symbol as a plurality of delay values. Each of the 
plurality of delay values includes an available value of the plurality of available values 
for each delayed version of the plurality of delayed versions. The encoded data is 
transmitted across a communications channel. In another embodiment of the invention, 

15 the first signal having positive entropy and the plurality of delayed versions of the first 
signal are summed. The plurality of delayed versions of the first signal includes the 
plurality of delay values for the symbol. In still another embodiment, the encoded data is 
decoded by identifying each transmitted, delayed version of the plurality of delayed 
versions of the first signal and determining a transmitted delay value of the plurality of 

20 delay values for each identified delayed version. For example, the first signal includes a 
chaotic signal, a noise signal, or a positive entropy, baseband signal modulated onto a 
positive entropy signal having a higher frequency than the baseband signal. 

In yet another embodiment of the invention, the decoding step includes the 
following steps. A second signal substantially similar to the first signal is generated. The 

25 second signal and a plurality of reference delays are summed. A cross-correlation is 
maximized between the encoded data and the sum of the second signal and the plurality 
of reference delays. In another embodiment, the plurality of reference delays is 
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5 compensated for degradation by the communications channel of the plurality of delayed 

versions of the first signal. 

In an alternate embodiment of the present invention, the decoding step includes 

the following steps. A weighted third signal substantially similar to the first signal is 

generated. The weighted third signal and a plurality of weighted reference delays are 

10 summed. A least squares fit is peformed between the encoded data and the sum of the 
third signal and the plurality of weighted reference delays. In still another embodiment, 
the plurality of weighted reference delays is compensated for degradation by the 
communications channel of the plurality of delayed versions of the first signal. 
An embodiment of the invention is directed to a bandwidth-efficient 

1 5 , communications method and/or system that takes advantage of the properties of positive 
entropy signals. The embodiment uses a carrier signal that has a positive entropy to add 
information to the transmission thereof. The information capacity of the modulated 
carrier is greater than it would be for a purely periodic carrier. The signal that functions 
as a carrier has a positive entropy, increasing the amount of information that may be 

20 transmitted on a signal. The embodiment of the delay communication method and 

system makes use of the positive entropy of the carrier signal as well as the entropy of the 
modulating signal. 

An embodiment of the present invention supports bandwidth-efficient 
transmission in communications media, wherein information is transmitted in a fixed 

25 bandwidth, such as in data networks using either wires or fiber optics, in land-line 
communications systems, e.g., telephone networks, that operate over wires or fiber 
optics, and in wireless communications networks. Bandwidth efficiency in such 

8 
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5 networks facilitates use of data-hungry applications such as video-on-demand and 

Internet access. Such bandwidth efficiency also reduces time required for data transfer, 

which, for example, makes unauthorized detection of the data transmission more difficult 

than it otherwise would be. 

1 0 Brief Description of the Drawings 

FIG. 1 is a graph of a power spectrum of a first sample chaotic map. 

FIG. 2 is a graph of a sample cross-correlation between a sample delay communication 

signal and a sample set of reference signals. 
1 5 FIG. 3 is a graph of a power spectrum of a second sample chaotic map. 

FIG. 4 is a graph of a power spectrum of a third sample chaotic map. 

FIG. 5 is a graph comparing bandwidth efficiencies of two quadrature amplitude 

modulation communications systems with bandwidth efficiencies of three 

communications systems according to the invention. 
20 FIG. 6 is a block diagram of a communications system according to the invention. 

FIG. 7 is a schematic diagram of an bandpass filter according to the invention. 

FIG. 8 is a flow chart of a method according to the invention. 

FIG. 9 is a block diagram of a computer system for executing computer-readable method 
steps according to the invention. 

25 

Detailed Description of the Invention 
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5 A delay communication method and system according to the invention is as 

follows. A time series is taken from a system having a positive entropy, such as a chaotic 

map or a noise signal. 

An illustrative chaotic map is 

*„+io = A*„ modl (!)• 
10 where ju =2.1. As part of the time series generation, this map is updated, for example, 
once every ten iterations in order to produce a low frequency signal x(t) . As described 
below, this low frequency signal is used to modulate a carrier. FIG. 1 shows the power 
spectrum of the output from the map of Eq. (1), which has a bandwidth of approximately 
0.1 Hz. 

15 Data, or information, is encoded by adding Xox(t) n delayed versions ofx(t). 

Each of the n delayed signals may have m delay values. The number of delay values is 
upper-bounded by inter-symbol interference. The signal that is transmitted is 

£(0 = *(0+5>(f+O (2) 

where each r i can have m values. The information to be encoded and transmitted 
20 includes symbols. For example, a text message includes alphanumeric and punctuation 
symbols. More specifically, each symbol in a symbol set for an n delay system is 
represented by a set of n delay values of n delayed versions of x(t). For instance, in a 
symbol set for a three delay system, each symbol is represented by the set of three delay 
values, the first delay value is a value of the function x(t + T\); the second delay value is a 
25 value of the function x(t + t 2 ); the third delay value is a value of the function x(t + t 3 ). 
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5 The ordering of the delay signals is not distinguishable, and no two delay signals 

are allowed to have the same delay value, so the total number of symbols in a symbol set 

for an n delay communication system is 

N _ m(m-lXm-2)...(m-K+l) 
n\ 

At the receiver, the transmitted signal is cross-correlated with a set of reference signals 
10 ^0 = *(0+ (4) 

7=1 

where x(t) is identical to, or substantially similar to, the x(t) signal in the transmitter. 
Cross-correlation is understood as follows. For two discrete signals x(i) and y(i), cross- 
correlation is C(r) = I { [x(i + t) - x_ave] * y(i) - y_ave]} / {£[(x(i) - x_ave) A 2] * E 
[(y(i) - y_ave) A 2]}, where x_ave is the average value of x(i), where y_ave is the average 

15 value of y(i), and where r is a delay. For continuous signals, the summations are replaced 
by integrals. Alternate definitions of cross-correlation omit the denominator of C(r), 
which in the cross-correlation formula above normalizes the cross-correlation so that the 
largest possible value is one. 

The similarity of the transmitted and reference signals must be sufficient to 

20 determine accurately the encoded data pursuant to the instant invention. A 

communications system having non-identical transmitted and reference signals has the 
same effect as a communications system having identical transmitted and reference 
signals, where the transmitted signal, for example, is corrupted by noise. Such corruption 
reduces optimum bandwidth efficiency. 

25 The cross-correlation is maximized when £(f) = % ref (t) , which is true when each 

signal uses the same set of delays. Cross-correlation between transmitted and reference 
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5 signals, for example, is used to identify which combination of delay values was used in 

the transmitted signal, to determine which symbol was transmitted. 

FIG. 2 demonstrates that cross-correlation is maximized when % t (t) = % ref (t). For 

FIG. 2, by way of illustration, the number of delays n = 1 and the signal x(t) is generated 
by the map of Eq. (1) with fi = 2.1. On the horizontal axis of FIG. 2 is plotted the delay 

10 value m. The vertical axis of FIG. 2 is the delay value for the reference signal. So, 4 is 
the delay value in timesteps of the delayed signal added to an undelayed signal, as in Eq. 
(2), while 5d is the delay value of the reference signal. FIG. 2 shows the cross-correlation 
between transmitted and reference signals, with white being 1 and black being 0. It can 
be seen in FIG. 2 that the cross-correlation is maximized when the reference delay is 

15 equal to the transmitted delay. That is, the largest cross-correlation occurs when the 
transmitted and reference signals have the same, or substantially the same, delay value. 

Information capacity is the largest amount of information that a signal can carry. 
Entropy is an upper bound on information capacity. That is, the information capacity C 
of a signal is less than or equal to the entropy H of the signal. This delay communication 

20 method should work for any broad band signal. However, for simplicity of illustration, 
signals having positive entropies that are easily calculated are used. So, for this example, 
1 -dimensional chaotic maps are used. However, in practice, multi-dimensional chaotic 
maps are alternatively beneficially used. 

In order to calculate the entropy of a signal, the generating partition of the signal 

25 must be known. In general, finding the generating partition is an unsolved problem, but 
for a 1 -dimensional map, the generating partition is defined by the set of critical points of 
the map. Thus, for the map of Eq. (1), the range of the map may be divided into three 

12 
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5 regions: 0 < x n < 1/2. 1 , 1/2. 1< x n < 2/2. 1 , and 2/2.1 <x w . If p t (xj is the probability that 

3 

x n falls into region i , then H = -]T /^(xjlogf/^x,)] . 

Using the logarithm base 2, the entropy of the signal x(t) from the map of Eq. (1) 
with // = 2.1 is 1.18 bits. The entropy of the map signal is an upper bound for the 
information capacity C of the map signal, and the information capacity C indicates the 
10 minimum signal to noise ratio for which error free communication is possible: 

C = |log(l + |) (5) 

where S/N means signal power divided by noise power. Using the carrier signal from the 
map of Eq. (1) with the number of delays n = 3 and the number of possible delay values 
m = 100, (where, in this example, delay values are spaced every 100 points), Eq. (3), gives 

15 161,700 possible combinations of delay values, or 17.3 bits of information. When 

Gaussian white noise (with the same bandwidth as the map signal) is added to the delay 
communication signal described here, and the length of each data interval is L = 100, 
error free communication for /u = 2.1 is possible for an S/N of 277, or an Eb/No of 34 dB. 
The information capacity C of a signal is also limited by its bandwidth. 

20 Bandwidth efficiency in bits/second/Hz is used to describe this capacity, or C/W, where 
Wis the signal bandwidth. For a simulated signal in which noise bandwidth = signal 
bandwidth = simulation bandwidth, 

where E\/Nq is the minimum energy in one bit normalized by the noise power spectral 
25 density for error free communication. For our map signal of Eq. (1 ), if each iteration 
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represents a time step of 1 s, then W= 0.1 Hz. If A N is the noise amplitude, then N 0 = A N 2 



I W. For a signal amplitude A s and a time of T b for 1 bit, E b = A s 2 T b . The bandwidth 
efficiency for the signal generated by the map of Eq. (1) is 17.3 bits/100 s/0.1 Hz = 1.73 
b/s/Hz. From Eq. (6), the bandwidth efficiency C/Wiox Eb/N 0 = 34 dB is 15 b/s/Hz. The 
calculated bandwidth efficiency C/W is the maximum possible bandwidth efficiency for 
error free communication, and it is greater than our value of 1 .73 b/s/Hz. 

Typically, a signal such as the map signal above is modulated onto a periodic 
carrier for transmission. If a carrier is used which is not periodic, but has a positive 
entropy, then the information capacity C of the transmitted signal can be increased. 

To generate an illustrative carrier signal y(t) 9 the following map is used. 



where h(y) acts like a modulus to keep y n +j between -1.0 and 1.0. The calculated entropy 
of the signal y(t) is 1.58 bits. 

To modulate this carrier, the signal x(t) from the map of Eq. (1) is used. 
FIG. 3 is the power spectrum from y(t) from the map of Eq. (7). 

The signal y(t) from the map of Eq. (7) is used by itself with a delay 
communication method and system having, for example, n = 3 delays and m = 100 
possible values. The delay values used are, for instance, every 100 points (i.e., delay 



y n+ i=h[g(y n )y n ] 




(7) 



y-2 y>\ 

y -\<y<\ 

y + 2 y<-\ 
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5 values of 100, 200, etc). For this example, 100 points are used for each bit of 

information; so, the bit duration is 100 s. The signal y(t) is filtered so that only 

frequencies between, for example, 0.27 and 0.37 Hz are passed, and the added Gaussian 

white noise is also filtered so that only these frequencies are passed. Once again, because 

the signal bandwidth, for instance, is 0.1 Hz, the bandwidth efficiency is 1.73 b/s/Hz. 

10 However, because of the higher entropy of the signal y(t), the minimum S/N is now 100 
and Ei/No = 30 dB (compared to 34 dB for x(t)). 

Finally, the combination signal z(t) = x(t)xy(t) is used with the delay 
communication method with the same parameters. This combination signal z(t) is an 
example of a positive entropy, baseband signal that is modulated onto a higher frequency 

15 positive entropy signal. The calculated entropy of z(t) is 2.76 bits, which is the sum of 
the entropies of x(t) andy^ . The bandwidth of signal and noise is once again 0.1 Hz. 
The minimum S/N for error free communication in this case is 22.7 and EtJNo = 23.5 dB, 
reflecting the larger entropy of the signal z(t) . 

The maps described above are useful for illustrating the general concepts of the 

20 delay communication method, but they do not have as high bandwidth efficiencies as 
possible according to the present invention. Higher bandwidth efficiencies are seen, for 
example, in chaotic flows. 

A chaotic system for use in accordance with the invention typically has a well- 
defined and controllable bandwidth. For example, a 6-dimensional version of a Rossler- 

25 like system is described by 
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^ = -a(0.02x, + 0.5;c 2 + x 3 + 0.5|x 4 |) 

dx 

— 1 = - a{-x x + 0.02jc 2 + x 6 ) (8) 
dt 

^ = -a(-s(*i)+* 3 ) 

^ =-10^(0.05^ + 0.5x 5 +x 6 ) 

^ = -\0ar f (-x 4 -0.13x 5 ) (9) 
dt 

^ = -l0ar f ( r g(x 4 )+x 6 ) 



(xul° X<3 \ 
8KX) [I5(x-3)x>3j (10) 

r f =l+y(x 2 +1.75) 

where a , which sets the overall time scale of the oscillator, is 1 . See, e.g., T. L. 
Carroll, "Chaotic communications that are difficult to detect," Physical Review E, vol. 
67, February pp. 026207, 2003, incorporated herein by reference. Eq. (9) is a Rossler 
oscillator whose time constant is modulated by r f , which is a function of x 2 from Eq. 

(8). See, e.g., O. E. Rossler, "The Chaotic Hierarchy," Z. Naturforsch., vol. 38a, July, 
pp. 788-801, 1983, incorporated herein by reference. Eq. (8) is a low frequency 
nonlinear oscillator driven by the higher frequency Rossler system of Eq. (9). The effect 
of the variable time constant r f is to broaden the power spectrum of the Rossler system 

of Eq. (9) by an amount determined by the factor y in Eq. (10). For the example 
presented here, y = 0.3 . Equations (8-10) are numerically integrated with a 4th order 
Runge-Kutta integration routine with a time step of 0.04. 
The transmitted signal is derived from 
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5 x t (t)= i * s ® f (11) 

V* 4 (0 +* 5 (0 

which is the sine of the phase angle of the Rossler attractor. The signal x t (t) has a 
constant envelope. FIG. 4 is a power spectrum of x t (t) from the flow of Eqs. (8-1 1), 
which has a bandwidth of 0.25 Hz . The delay communication signal £(0 (defined, by 
way of example, in Eq. (2)) is optionally also bandpass filtered by, for instance, a digital 

10 FIR filter with a bandwidth of 0.25 Hz to insure a well defined bandwidth. 

The Rossler signal is transmitted with, for instance, three, four, five, or more 
delays. The possible delays ranged from 0.4 s (10 points) to 40 s (1000 points), and are 
spaced, for instance, every 0.4 s (10 points), for 100 possible delay values. The 
transmitted delays are detected by computing the cross-correlation of a stored reference 

15 signal with the transmitted signal. For three delays, Eq. (3) gives a total of 161,700 
possible delay combinations. For example, 100 points are transmitted using 4.0 s for 
each data interval. The bandwidth efficiency is therefore log2(161,700)/(4 s)/(0.25 Hz), 
or 17.3 bits/s/Hz. When four delays are used, there are 3,921,225 possible combinations, 
for a bandwidth efficiency of 21 .9 bits/s/Hz, and five delays give 75,287,520 possible 

20 combinations, or 26.1 bits/s/Hz. In terms of practical detection times, the maximum 
number of delays is dependent on processor speed and/or power. More powerful or 
speedier general processors or specialized processors enable a greater number of delays 
to be used, thereby yielding a larger symbol set or constellation of symbols available for 
conveying information than would otherwise be possible. 

25 The finite bandwidth of the channel makes it impossible to instantly change the 

transmitted signal from one interval to the next, so the signal from one interval will 
interfere with the signal in the next interval. This inter-symbol interference is accounted 

17 
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for, in an embodiment of the invention, in order to insure an accurate comparison of the 
transmitted signal with the reference signals. 

In order to simulate a narrow band channel, the signal %(t) is filtered by a finite 
impulse response ("FIR") filter. A FIR filtered signal y(t) is given by 

N-\ 



(12) 



10 where x(t) is the input signal, the filter has N stages, and r is the time step for the 
digitized time series. TV is set to, for instance, 50. 

Each data interval (symbol) is L points long. Because the FIR filter is a weighted 
sum of the previous points in the time series, the filtered signal from every data interval 
contains a contribution from the previous data interval In creating the reference signal, it 

15 is optional, though advantageous, to take into account this inter- symbol interference. 
Because the FIR filter is linear, each delayed data segment is pre-filtered individually 
before adding them together to form the reference signal. For n delays, the reference 
signal is 



(13) 



7 = 0 



%<0= 



L-i 



Z a ;VV_/(-y-l) i<L 
0 i>L 



^(Xjxij -i + kr) i<L 

j = 0 

I 

J^jz fiQ - i + kr) i> L 



(14) 



18 



Inventor: Carroll PATENT APPLICATION 

Attorney Docket No, NC 84,775 

5 where the a*s are the FIR filter coefficients, and Wo is the inter-symbol interference term, 

i.e., the contribution to the signal from the previous interval. The set of signals x k /i) is 

the set of pre-filtered delayed data segments. 

An alternative solution to addressing inter-symbol interference includes 

transmitting filler between symbols in the transmitted signal. Another solution to 

10 addressing inter-symbol interference includes transmitting a known symbol between 

symbols in the transmitted signal. The latter solution effectively elongates each symbol 

in the transmitted signal transmitted across the communications channel. 

Assuming a good estimate of the channel filtering, the transmitted signal and the 

reference signal is started with the same initial condition so that the reference filter is 

15 properly initialized. For completeness, a case below is considered where the reference 

filter is not a perfect match for the channel filter. 

To illustrate a sample communication, the signal of Eq. (1 1) is transmitted with 

three, four, or five delays. The channel bandwidth is, for example, 0.25 Hz. The 

reference signal is equalized as described above. Gaussian white noise with a bandwidth 

20 of, for instance, 0.25 Hz is added to the transmitted signal. 

In this example, for all delay combinations, the smallest value of E\fNo for which 

error free communication is possible is 48 dB (wherein the S/N is 26). Replacing the 

chaos signal with filtered Gaussian noise results in the same value of EiJNo. The fact that 

the minimum Et/No is the same for three, four, or five delays suggests that the 

25 performance of this system is limited by the filtering. 

When the signal bandwidth, noise bandwidth and simulation bandwidth are all the 

same, the minimum value of Ei/No for a given bandwidth efficiency (bits/sec/Hz) is given 
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5 by Eq. (6). For the communication system here, Eq. (6) does not apply, since the 

simulation bandwidth is not the same as the noise or signal bandwidth. In a standard 

communication system based on a periodic carrier, the carrier adds no information, so a 

baseband analysis could be used in which only the modulating signal is considered. In 

the instant invention, a separation into baseband signal and carrier is not possible because 

10 the carrier also contains some information. 

FIG. 5 shows the bandwidth efficiencies for various communications systems. 
For three delays, the bandwidth efficiency communication for the above-described 
illustrative system is 17.3 bits/4 sec/0.25 Hz = 17.3 b/s/Hz. For four delays, the 
efficiency is 21.9 b/s/Hz, and for five delays, the efficiency is 26.1 b/s/Hz. These 

15 numbers are plotted in FIG. 5, along with the relation from Eq. (6), the theoretical 

maximum for signals where signal bandwidth is equal to or substantially equal to noise 
bandwidth, which in turn is equal to or substantially equal to simulation bandwidth. It 
can be seen that for four or five delays, the bandwidth efficiency of this method exceeds 
the efficiency theoretically possible according to Eq. (6), but there is no contradiction 

20 because Eq. (6) does not apply in this situation. From Eq. (5), the maximum number of 
bits that can be transmitted in a data interval of length L = 100 for a S/N of 26 is 100 
samples x 4.7 bits/sample = 470 bits, which is much greater than what is actually being 
sent. So, there is no contradiction with information theory. 

FIG. 5 also shows the theoretical bandwidth efficiencies for 16 and 64 level 

25 quadrature amplitude modulation (e.g., 16QAM and 64QAM), which are existing high 
bandwidth efficiency communication methods. 
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5 In a real communication system, there is difficulty in accurately matching the 

channel filter for equalization purposes. The effects of imperfect filtering are illustrated 
as follows. The Rossler signal with three or four delays is sent through a 12 bit digital-to- 
analog converter to produce an analog signal. The analog signal is optionally filtered 
with the filter in FIG. 7, which, by way of example, is a second order bandpass filter with 

10 a Q=4 and a center frequency of 17,580 Hz. The components of the bandpass filter 

shown in FIG. 7 have the following illustrative values: Rl = 1 kQ, R2 = 3621 Q, R3 = 
7242 Q, R4 = 1 16.8 Q, CI = 0. 1 pF, and C2 = C3 = 0.01 jaF. The filtered signal is 
digitized by, for instance, a different computer. Optionally, if the clock rates of the 
computer associated with the encoder side and the computer associated with the decoder 

15 side do not match exactly, a separate sync signal is also transmitted to indicate the 
beginning of each data interval. 

Several different lengths L for each data interval are used. To perform 
equalization of the digitized signal, a 100 stage FIR filter, for example, is used. The filter 
coefficients are found by minimizing the difference between filtered and unfiltered 

20 versions of the same chaotic Rossler signal. 

For both three and four delays, for example, the minimum data interval L for 
which error free communication is possible is 300 points. The data rate for the D/A 
converter is 400,000 pts/sec, so a 300 point data interval is 7.5 x 10" 4 s, and the signal 
bandwidth is 4000 Hz. For three delays, the resulting bandwidth efficiency with the 

25 fitted filter is 5.7 b/s/Hz, and for four delays the efficiency is 7.3 b/s/Hz. The same 

bandwidth efficiencies are seen when a filtered Gaussian noise signal is used instead of 
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5 the chaos. Errors in the equalization filter (and noise introduced by D/A and AID 

converters) reduce the bandwidth efficiency. 

Combining delayed signals, as described above, creates a large number of 

symbols, making high bandwidth efficiencies possible. But, detecting these symbols by 

cross-correlating with every possible reference symbol is a very slow process, depending 

10 on available processor speed or power. In a less processor-intensive embodiment of the 

invention, the transmitted symbols are detected with much less computation by doing a 

least squares fit to the reference symbols. In this case, the transmitted signal is modeled 

by 

m 

6(0 = A*(0+ZM' + O O 5 ) 

15 where the J3 f s are weighting coefficients that must be fit, and the sum extends from i=l to 
/=100 for 100 possible delay values. A singular value decomposition is used to do the 
fitting. Equalization is performed as above, assuming a perfect filter match. See, e.g., 
W. H. Press, B. P. Flannery, S. A. Teukolsky, and W. T. Vetterling, Numerical 
Recipes. New York: Cambridge University Press, 1990, incorporated herein by 

20 reference. 

The least squares fitting procedure is faster but less robust than using cross- 
correlations to find the delays. For three delays and a 100 point (4 s) data interval, for 
example, the minimum E\/Nq for error free communication is 94 dB, compared to 57 dB 
for the cross correlation method. If an 800 point (32 s) data interval is used, the 
25 minimum E\JNq is 48 dB, but the bandwidth efficiency in this case is 2.1 b/s/Hz. Similar 
results are seen for four, five, or six delays. For six delays, a bandwidth efficiency of 30 
dB requires an E1/N0 of 94 dB, while an efficiency of 3.7 b/s/Hz requires 58 dB. As can 
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5 be seen, the least squares fitting method is much faster than the cross correlation method, 

but it is also much less noise robust. 

Utilizing a carrier signal with a positive entropy makes it possible to increase the 

amount of information transmitted in a given bandwidth. In some cases, the amount of 

information in bits/second/Hz appears to exceed the theoretical channel capacity, but only 

10 because the well known theoretical limit (Eq. (6)) is derived for the special case of signal 
bandwidth=noise bandwidth=simulation bandwidth. Achieving large bandwidth 
efficiencies depends on accurately matching the filtering effects of the channel; filter 
mismatch reduces the bandwidth efficiency. Detection can be slow when there are many 
symbols, but there are other detection techniques that can speed up the detection process, 

1 5 although they require a larger signal to noise ratio than the straightforward method of 
computing cross-correlations. 

It should be understood that other signals with positive entropy, such as noise 
signals, are also useful information carrier signals. For example, a noise signal for use as 
a carrier is sampled from an antenna, from a electrical circuit, and/or from pseudo-noise 

20 generated by a computer algorithm. 

FIG. 6 shows a block diagram of an exemplary architecture of a communications 
system in accordance with the present invention. Symbol encoder 600 receives data, to 
be encoded. Generator 610 transmits a carrier signal having positive entropy x(t) to the 
symbol encoder 600. The symbol encoder 600 encodes the data by representing the data 

25 as a sum of the carrier signal having positive entropy and a plurality of delayed versions 
of the carrier signal having positive entropy, as described above. The encoded data is 
then optionally passed through a filter, such as a bandpass filter 620, so that the 
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5 bandwidth of the encoded data is less than or substantially equal to the bandwidth of a 

communications channel 630 through which the encoded data passes. For instance, if the 

carrier signal x(t) occupies a greater bandwidth than the communications channel 630, 

then the filter 620 is advantageous. A transmitter 640 transmits the encoded data through 

the communications channel 630. 

10 A receiver 650 receives the encoded data from the communications channel 630 

and transmits the encoded data to an optional equalizer 660, the operation of which is as 
described above. The outputs of the equalizer 660 and a generator 670 of a signal having 
positive entropy are inputted to a symbol decoder 680. The output of generator 670 and 
the output of generator 610 are substantially similar, and preferably identical. The 

15 symbol decoder 680, as described above, identifies each symbol in the original data by 
determining the delayed versions of the carrier signal having positive entropy that were 
added to the carrier signal having positive entropy and the delay values of those delayed 
versions. 

If the carrier signal having positive entropy being used is a noise signal, a copy of 
20 the noise signal is stored as a reference at the encoder side as well as at the decoder side. 
If the carrier signal having positive entropy being used is a chaotic signal, a copy of the 
chaotic signal can be stored as a reference on the encoder and/or decoder sides, or the 
chaotic signal can be derived from an equation and defined initial conditions at the 
encoder and/or decoder sides. 
25 FIG. 8 is an illustrative flow chart of an encoding and/or decoding method in 

accordance with the instant invention. Optionally, one or more of the steps of the flow 
chart at least partially form the basis of computer-executable instructions in accordance 
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5 with the present invention. In Step SI 00, the time series of a signal having positive 

entropy is taken. In Step SI 10, a carrier signal having positive entropy x(t) is generated 

based on the time series of Step SI 00. In Step SI 20, input data is encoded by encoder 

600 by adding x(t) to delayed versions of x(t). In optional Step SI 30, the encoded data is 

passed through a filter 620, for instance, if x(t) occupies a greater bandwidth than that of 

10 the communications channel or medium 630. In Step SI 40, the encoded data is 

transmitted by transmitter 640 across the communications channel 630. In Step SI 50, the 
transmitted, encoded data is received by the receiver 650 from the communications 
channel 630. In Step SI 60, the received encoded data is optionally passed through an 
equalizer to reduce the effect of the communications medium on any or each of the 

15 encoded symbols in the encoded data. In Step SI 70, each symbol in the encoded data is 
decoded by decoder 680 by determining the delayed versions of x(t) that were added to 
x(t) and the delay values for each of the delayed versions. 

FIG. 9 is a block diagram of an exemplary architecture of a computer, for 
example, that executes one or more programs or instruction sets in accordance with the 

20 instant invention. The computer suitable for interaction with the interactive platform of 
the invention includes a CPU 900 connected to bus 910. The computer includes a main 
memory 920, a display controller 930 with accompanying display 940. A memory 
controller 960 interfaces at least one of a plurality of storage devices such as a CD ROM 
970, a floppy drive 980, and a hard drive 990. A network interface card 950 permits 

25 access to a network for the computer. Main memory 920 optionally includes volatile 
memory. For instance, CPU 900 executes computer-readable instructions implementing 
the method steps or functions described above. 
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5 Obviously, many modifications and variations of the present invention are 

possible in light of the above teachings without departing from the true scope and spirit 

of the invention. It is therefore to be understood that the scope of the invention should be 

determined by referring to the following appended claims. 
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